#python program to recursively download files and folders from an AWS S3 bucket in Azure Databricks

[amalgjose]

Python program to download files recursively from AWS S3 bucket to Databricks DBFS

S3 is a popular object storage service from Amazon Web Services. It is a common requirement to download files from the S3 bucket to Azure Databricks. You can mount object storage to the Databricks workspace, but in this example, I am showing how to recursively download and sync the files from a folder within an AWS S3 bucket to DBFS. This program will overwrite the files that already exist. The…